HBASE-30051 Avoid Unnecessary Protobuf Conversions in HMaster Admin API Calls#8018
HBASE-30051 Avoid Unnecessary Protobuf Conversions in HMaster Admin API Calls#8018srinireddy2020 wants to merge 1 commit intoapache:masterfrom
Conversation
|
Do you have any performance numbers about the overhead? |
Verified performance test in HBase Mini cluster with 350 tables. Observed 97.5% improvement for this changes. Method: admin.listTableDescriptors(true)
|
|
I mean the performance change in real workload. I see that you have changed two places, what is the performance numbers for these two places before and after this PR? |
I validated the performance test on a real HBase cluster with 400 tables. Here are the observations: For rsGroup changes observed 42.5% improvement. For RSGroup (with out fix)
|
Admin APIs invoked on the HMaster are routed internally back to the same HMaster instance, leading to unnecessary protobuf serialization and deserialization. This adds significant overhead, especially in environments with a large number of tables.